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DETAILED ACTION 

1 ) This is a Final Rejection in response to the Remarks filed on 7/21/05. 

2) Claims 1-22 are pending and rejected in this application, 

3) The examiner does NOT introduces any new lines of rejections. 

Claim Rejections - 35 USC § 103 

4) The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 1 02 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

4-1) Claims 1, 2, 3, 4, 5, 6, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 19, 20, 21, 22 are 

rejected under 35 U.S.C. 103(a) as being unpatentable over Carleton et al (US 

Patent 5781727, issued Jul 1998) in view of TYan (US Patent 6054990, filed Jul 

1996), further in view of Simonoff (US 6351777, filed Apr 23, 1999), further in view 

of Cass (US 5692073, issued Nov 1997). 

In regard to independent claim 1, Carleton teaches a plurality of workstations 

comprising a computer processor, a display (ie., computers linked together 

displaying)(col 1 , line 65 - col 2, line 5). Carleton does not expressly teach, but Iran 

teaches a capture device for capturing a digital image of a document (ie., text or 

graphical illustration, camera , electronic notepad; digital )(co 2, lines 59-63; col 7, lines 

46 - 60). 
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Carleton teaches a base computer communicating with the plurality of 
workstation (ie., a single computer runs an application and displays on other 
computers)(col 1 , line 65 - col 2, line 5). 

Carleton does not express teach but Iran teaches (a) identify handwritten annotations in 
digital images of document captured at each workstation (ie., handwritten recognition software 
for entry/display of pen-based computer as an electronic notepad for annotating photographs, 
pictures captured by a camera that is uploaded to a user computer) (col 7, lines 55-65). 

Carleton in view of Tran doesn't expressly teach, but Simonoff teaches (b) 
communicate data ... plurality of workstations (ie., users at dissimilar computers can 
annotate the information presented to all users)(col 1 , lines 20-25). 

Carleton in view of Tran does not expressly teach, but Simonoff teaches (c) use 
of data ... each workstation (ie., a decoder at client computer that decodes at a user 
location so user can work on his/her own version)(col 4, lines 40-50). 

Carleton in view of Tran does not expressly teach, but Simonoff teaches (d) 
displaying ... first and second workstations (ie., first and second users instantiate 
objects on the whiteboard clients, that are relayed to the other clients)(col 7, lines 5-18). 

Carleton in view of Tran does not expressly teach, but Simonoff teaches the one 
or more ... each workstation (ie., at each client computer, the interpreter decoder 
decodes information specifying an operation to be performed at user)(col 4, lines 44- 
50). 

Carleton in view of Tran and Simonoff does not teach, but Cass teaches 
annotations on a "hardcopy" document (ie., image of a marked document instance, an 
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image of a particular hardcopy instance of a document and on which instance the use 
has made a mark (... graphical or written annotations))(Cass, lines 12-19). 

It would have been obvious to one of ordinary skill in the art at the time of the 
invention to modify Carleton to include digital/graphical electronic files and handwritten 
annotations as taught by Tran, providing the benefit of aeating and attaching text or 
graphical illustrations to a message, file, data set including photographic annotations 
depicting circumstances leading up the photograph/graphical image (Tran, col 2, lines 
59-67), further to include users at dissimilar computers annotating the information 
presented to users, a decoder at client computer that decodes at a user location 
specifying an operation to be performed at user location, where first and second users 
collaboratively annotate objects on the whiteboard as taught by Simonoff, providing the 
benefit of facilitating interchange of information between two or more dissimilar 
computer users, where users can annotate the information presented to all users 
(Simonoff, 1 , lines 20-30) further to include annotations of an image of an image of a 
particular hardcopy instance document as taught by Cass, providing the benefit of using 
formless forms offering a new flexibility when applied in existing paper based user 
interfaces also providing new applicafions for paper-based user interface (Cass, col 3, 
lines 30-37). 

In regard to independent claim 11, Carleton teaches a plurality of workstations 
comprising a computer processor, a display (ie., computers linked together 
displaying)(col 1 , line 65 - col 2, line 5). Carleton does not expressly teach, but Tran 
teaches a capture device for capturing a digital image of a document at each 
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workstation (ie., text or graphical illustration, camera , electronic notepad; digital )(co 2, 
lines 59-63; col 7, lines 46 - 60). 

Carleton teaches a base computer communicating with the plurality of 
workstation (ie., a single computer runs an application and displays on other 
computers)(col 1, line 65 - col 2, line 5). 

Carleton does not express teach but Tran teaches identifying . . . workstation (ie., 
handwritten recognition software for entry/display of pen-based computer as an electronic 
notepad for annotating photographs, pictures captured by a camera that is uploaded to a user 
computer) (col 7, lines 55-65). 

Carleton in view of Tran doesn't expressly teach, but Simonoff teaches (c) 
distributing data ... plurality of workstations (ie., users at dissimilar computers can 
annotate the information presented to all users)(col 1, lines 20-25). 

Carleton in view of Tran does not expressly teach, but Simonoff teaches (d) 
using the data ... each workstation (ie., a decoder at client computer that decodes at a 
user location so user can work on his/her own version)(col 4, lines 40-50). 

Carleton in view of Tran does not expressly teach, but Simonoff teaches (e) 
displaying ... first and second workstations (ie., first and second users instantiate 
objects on the whiteboard clients, that are relayed to the other clients)(col 7, lines 5-18). 

Carleton in view of Tran does not expressly teach, but Simonoff teaches the one 
or more ... each workstation (ie., at each client computer, the interpreter decoder 
decodes information specifying an operation to be performed at user)(col 4, lines 44- 
50). 
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Carleton in view of Iran does not expressly teach, but Simonoff teaches wherein 
the one or more ... annotation's creation and author (ie., user can select shapes to 
annotate the whiteboard/image)(fig 7). 

Carleton in view of Iran and Simonoff does not teach, but Cass teaches 
annotations on a "hardcopy" document (ie., image of a marked document instance, an 
image of a particular hardcopy instance of a document and on which instance the use 
has made a mark (... graphical or written annotations))(Cass, lines 12-19). 

It would have been obvious to one of ordinary skill in the art at the time of the 
invention to modify Carieton to include digital/graphical electronic files and handwritten 
annotations as taught by Tran, providing the benefit of creating and attaching text or 
graphical illustrations to a message, file, data set including photographic annotations 
depicting circumstances leading up the photograph/graphical image (Tran, col 2, lines 
59-67), further to include users at dissimilar computers annotating the information 
presented to users, a decoder at client computer that decodes at a user location 
specifying an operation to be peri'ormed at user location, an annotation selection where 
first and second users collaboratively annotate objects on the whiteboard as taught by 
Simonoff, providing the benefit of facilitating interchange of information between two or 
more dissimilar computer users, where users can annotate the information presented to 
all users (Simonoff, 1 , lines 20-30) further to include annotations of an image of an 
image of a particular hardcopy instance document as taught by Cass, providing the 
benefit of using formless forms offering a new flexibility when applied in existing paper 



Application/Control Number: 09/738,992 Page 7 

Art Unit: 2176 

based user interfaces also providing new applications for paper-based user interface 
(Cass, col 3, lines 30-37). 

In regard to independent claim 12, Carleton teaches a plurality of workstations 
comprising a computer processor, a display (ie., computers linked together 
displaying)(col 1 , line 65 - col 2, line 5). Carleton does not expressly teach, but Iran 
teaches a capture device for capturing a digital image of a document (ie., text or 
graphical illustration, camera , electronic notepad; digital )(co 2, lines 59-63; col 7, lines 
46 - 60). 

Carleton teaches a base computer communicating with the plurality of 
workstation (ie., a single computer runs an application and displays on other 
computers)(col 1, line 65 - col 2, line 5). 

Carleton does not express teach but Iran teaches (a) identifying handwritten annotations 
in digital images of document captured at each workstation (ie., handwritten recognition software 
for entry/display of pen-based computer as an electronic notepad for annotating photographs, 
pictures captured by a camera that is uploaded to a user computer) (col 7, lines 55-65). 

Carleton in view of Iran doesn't expressly teach, but Simonoff teaches (b) 
communicating data ... plurality of workstations (ie., users at dissimilar computers can 
annotate the information presented to all users)(col 1, lines 20-25). 

Carleton in view of Tran does not expressly teach, but Simonoff teaches (c) using 
the data representing ... each workstation (ie., a decoder at client computer that 
decodes at a user location so user can work on his/her own version)(col 4, lines 40-50). 
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Carleton in view of Iran does not expressly teach, but Simonoff teaches (d) 
displaying ... first and second workstations (ie., first and second users instantiate 
objects on the whiteboard clients, that are relayed to the other clients)(col 7, lines 5-18). 

Carleton in view of Tran does not expressly teach, but Simonoff teaches the one 
or more ... each workstation (ie., at each client computer, the interpreter decoder 
decodes information specifying an operation to be performed at user)(col 4, lines 44- 
50). 

Carleton in view of Tran and Simonoff does not teach, but Cass teaches 
annotations on a "hardcopy" document (ie., image of a marked document instance, an 
image of a particular hardcopy instance of a document and on which instance the use 
has made a mark (... graphical or written annotations))(Cass, lines 12-19). 

Carleton in view of Tran and Simonoff does not teach, but Cass teaches 
annotations on a "hardcopy" document (ie., image of a marked document instance, an 
image of a particular hardcopy instance of a document and on which instance the use 
has made a mark (... graphical or written annotations))(Cass, lines 12-19). 

It would have been obvious to one of ordinary skill in the art at the time of the 
invention to modify Carteton to include digital/graphical electronic files and handwritten 
annotations as taught by Tran, providing the benefit of creating and attaching text or 
graphical illustrations to a message, file, data set including photographic annotations 
depicting circumstances leading up the photograph/graphical image (Tran, col 2, lines 
59-67), further to include users at dissimilar computers annotating the information 
presented to users, a decoder at client computer that decodes at a user location 
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specifying an operation to be performed at user location, where first and second users 
collaboratively annotate objects on the whiteboard as taught by Simonoff, providing the 
benefit of facilitating interchange of information between two or more dissimilar 
computer users, where users can annotate the information presented to all users 
(Simonoff, 1 , lines 20-30), further to include annotations of an image of an image of a 
particular hardcopy instance document as taught by Cass, providing the benefit of using 
formless forms offering a new flexibility when applied in existing paper based user 
interfaces also providing new applications for paper-based user interface (Cass, col 3, 
lines 30-37). 

Regarding claim 2, 13, Carleton in view of Iran does not expressly teach, but 
Simonoff teaches an additional annotation made by the first or second workstations (ie., 
user can add objects to whiteboard displayed; update information)(col 1 6, lines 25-34; 
col 1 , line 24). It would have been obvious to one or ordinary skill that to update the 
distribution of annotations to the plurality of workstations (ie., col 1, line 24 teaches 
updating the information presented to all users). 

It would have been obvious to one of ordinary skill in the art at the time of the 
invention to modify Carleton in view of Iran to include adding objects to whiteboard 
displays to update information as taught by Simonoff, providing the benefit of facilitating 
collaboration between a plurality of users (Simonoff, Abstract section). 

In regard to dependent claim 3, 14, Carleton does not teach, but Iran teaches 
capture device at least one workstation comprises a camera (ie., digital 
camera)(Abstract). 
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It would have been obvious to one of ordinary skill in the art at the time of the 
invention to modify Carleton to include a camera as taught by Iran, providing the 
benefit of annotations to graphical messages, files (Iran, col 2, lines 59-65). 

In regard to dependent claim 4, 15, Carleton teaches information representing 
the annotation as a bitmap (ie., annotations need bitmap)(col 10, line 9-11). 

Carleton teaches information indicating the location of the annotation in a 
document (ie., annotation logic draws corresponding annotation at the remote computer 
as from the original computer)(col 7, lines 28-38). 

Carleton in view of Trap and Simonoff does not teach, but Cass teaches 
annotations on a "hardcopy" document (ie., image of a marked document instance, an 
image of a particular hardcopy instance of a document and on which instance the use 
has made a mark (,.. graphical or written annotations))(Cass, lines 12-19). 

It would have been obvious to one of ordinary skill in the art at the time of the 
invention to modify Carleton in view of Iran and Simonoff to include annotations of an 
image of an image of a particular hardcopy instance document as taught by Cass, 
providing the benefit of using formless forms offering a new flexibility when applied in 
existing paper based user interfaces also providing new applications for paper-based 
user interface (Cass, col 3, lines 30-37). 

In regard to dependent claim 5, 16, Carleton in view of Iran does not expressly 
teach, but it would have been obvious with Simonoff's teachings to have annotation 
object ... annotation (ie., the server maintains a list of files and their origination, where 
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the files contain annotations/updates from various client users (col 1 0, lines 35-65; Fig 
6). 

It would have been obvious to one of ordinary skill in the art at the time of the 
invention to modify Carleton in view of Iran to include a server that maintains a list of 
files and their origination as taught by Simonoff, providing the benefit of facilitating 
collaboration between a plurality of users (Simonoff, Abstract section) and distinguishing 
the origin location of annotations. 

In regard to dependent claim 6, 17, Carleton in view of Tran does not teach, 
but it would have been obvious with Simonoff s teachings to have annotation ... 
annotation (ie., the server maintains a list of files and their meta-data associated with 
files that contain annotations)(Fig 6, see column labeled 'uploaded'). 

It would have been obvious to one of ordinary skill in the art at the time of the 
invention to modify Carleton in view of Tran to include a server that maintains a list of 
files and their meta-data associated with files that contain annotations as taught by 
Simonoff, providing the benefit of facilitating collaboration between a plurality of users 
(Simonoff, Abstract section). 

In regard to dependent claim 8, Carleton in view of Tran does not expressly 
teach, but Simonoff teaches plurality of workstations ... origin of the annotation (ie., 
individual user selects a drawing color for the annotations)(col 1 1 , lines 44-45). 

It would have been obvious to one of ordinary skill in the art at the time of the 
invention to modify Carleton in view of Tran to include individual user to select a 
drawing color as taught by Simonoff, providing the benefit of facilitating collaboration 
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between a plurality of users (Simonoff, Abstract section) and distinguishing the origin 
location of annotations. 

In regard to dependent claim 9, Carleton teaches "each workstation is ^ 
operative to identify handwritten annotations" (col 1 , lines 65 - col 2, line 5). 

In regard to dependent claim 10, Carleton does not specifically teach, but Iran 
teaches "the base computer is operative to identify handwritten annotations" (col 7, lines 
46 - 65). 

It would have been obvious to one of ordinary skill in the art at the time of the 
invention to modify Carleton to include a base computer that accepts handwritten input 
as taught by Tran, providing the benefit of attaching graphical illustrations with 
annotations as an option for users. 

In regard to dependent claim 19, Carleton teaches "annotations originating 
from at least two different other workstations"(ie., three mouses, three cursors, three 
arrows)(col 4, lines 60-67). 

In regard to dependent claim 20, Carleton in view of Tran does not expressly 
teach, but Simonoff teaches plurality of workstations ... origin of the annotation (ie., 
individual user selects a drawing color for the annotations)(col 1 1 , lines 44-45). 

It would have been obvious to one of ordinary skill in the art at the time of the 
invention to modify Carleton in view of Tran to include individual user to select a 
drawing color as taught by Simonoff, providing the benefit of facilitating collaboration 
between a plurality of users (Simonoff, Abstract section) and distinguishing the origin 
location of annotations. 
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Regarding claim 21, 22, Simonoff teaches one or more of ... author (ie., 
whiteboard server maintains the specific client origination of the upload ... identity of 
user)(ie., col 10, lines 35-44). 

It would have been obvious to one of ordinary skill in the art at the time of the 
invention to modify Carleton in view of Iran to include whiteboard server that maintains 
the specific client origination of the upload, including identity of user as taught by 
Simonoff, providing the benefit of facilitating collaboration between a plurality of users 
(Simonoff, Abstract section) and distinguishing the origin location of annotations. 
4-2) Claims 7, 18 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Carleton (as cited above) in view of Tran (as cited above) and Simonoff (as 
cited above), further in view of Levine et al (US Patent 5680636, issued Oct 1997), 
further in view of Cass (as cited above). 

In regard to dependent claim 7, 18, Carleton in view of Tran does not teach, 
but Levine teaches information representing the identity of the document with which the 
annotation is associated (ie., files per annotation are catalogued in a table of contents 
file referred to as a superfile... associated with a particular document)(col 7, lines 1-7). 

Carleton in view of Tran, Simonoff and Levine does not teach, but Cass teaches 
annotations on a "hardcopy" document (ie., image of a marked document instance, an 
image of a particular hardcopy instance of a document and on which instance the use 
has made a mark (... graphical or written annotations))(Cass, lines 12-19). 

It would have been obvious to one of ordinary skill in the art at the time of 
the invention to modify Carleton in view of Tran and Simonoff to include a catalog of 
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annotations as taught by Levine, providing the benefit of having a friendlier computer 
device (col 1 , lines 50-55) and a means to access the documents that contain 
annotations further to include annotations of an image of an image of a particular 
hardcopy instance document as taught by Cass, providing the benefit of using formless 
forms offering a new flexibility when applied in existing paper based user interfaces also 
providing new applications for paper-based user interface (Cass, col 3, lines 30-37). 

Response to Arguments 

Applicant's arguments filed 7/21/05 have been fully considered but they are not 
persuasive. On page 10, Applicant primarily argues that the references in combination 
fail to teach the elements and limitations of the Application. Specifically, the applicant 
argues that the combination of references does not teach identifying handwritten 
annotations made to a hardcopy document captured at a plurality of workstations, ... 
display criteria of each work station and the references fail to suggest users at different 
locations to work collaborately on a hardcopy document (see Applicant's Remarks 
section, page 10, middle to bottom, comprehensively). 

Examiner disagrees because the references when taken together suggest the 
elements and limitations of Applicant's claimed invention. Specifically, the Iran 
reference teaches the computer system with handwriting annotation, while the other 
references abundantly teach collaboration on forms and paper documents. 
Furthermore, Cass teaches an image of a particular hardcopy instance of a document 
and on which instance the user has made a mark (annotafion) with a pen, ... (Cass, 
page 8, lines 12-19). 
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The Examiner contends that the claimed invention would have been obvious to 
one of ordinary skill in the art at the time of the invention based on the suggestions and 
teachings of Carlton, Tran, Simonoff and Levine taken together. One would have been 
motivated to combine these teachings to arrive at the claimed invention because of the 
knowledge well established in the art at the time of the invention, which would render 
the claimed invention as well known. The Examiner introduces a few references as 
supportive evidence of known relevant art at the time of the invention in response to 
Applicant's arguments. First, Hanson et al (US 6507865, filed Jan 14, 2000), which 
teaches a method and system for group content collaboration across a network. 
Specifically, Hanson teaches overlaying media objects including annotations of text on. 
objects such as collaboration on greeting cards (see page 13, col 60 - col 14, line 5). 
Second, Kumar et al (US 6342906, filed Feb 2, 1999) teaches Annotation layer for 
synchronous collaboration. 

Conclusion 

THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1 .1 36(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 .1 36(a) will be calculated from the mailing date of 
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the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the mailing date of this final action. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Gautam Sain whose telephone number is 571-272- 
4096. The examiner can normally be reached on M-F 9-5 EST. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor. Heather Herndon can be reached on 571-272-4136. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 
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